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Abstract Inspired by the dissipative quantum 
model of brain, we model the states of neural 
nets in terms of collective modes by the help of 
the formalism of Quantum Field Theory. We 
exhibit an explicit neural net model which al- 
lows to memorize a sequence of several informa- 
tions without reciprocal destructive interference, 
namely we solve the overprinting problem in such 
a way last registered information does not de- 
stroy the ones previously registered. Moreover, 
the net is able to recall not only the last regis- 
tered information in the sequence, but also any- 
one of those previously registered. 



The quantum model of brain by Umezawa 
and Ricciardi [2], p| Q has attracted much 
attention in recent years. Moreover, its ex- 
tension to dissipative dynamics M , aimed to 



solve the long standing problem of memory 
capacity, provides an interesting framework 
to study consciousness related mechanisms. 
On the other hand, computational neuro- 
science mostly relies on specific activity of 
neural cells and of their networks, thus lead- 
ing to a number of models and simulations 
of the brain activity in terms of neural nets, 
mostly based on modern methods of statisti- 
cal mechanics and of spin glass theory . 
Besides, there is an increasing interest in the 
study of quantum features of network dy- 
namics, either in connection with informa- 
tion processing in biological systems, or in 
relation with a computational strategy based 
on the system quantum evolution (quantum 
computation) . 

Inspired thus by the papers [jl], ||, |3| and 
H (see also ||, [u|), we explore the possi- 
bility of modeling the states of neural nets in 
terms of collective modes by the help of the 
formalism of Quantum Field Theory (QFT). 

We show that the classical limit of the dis- 
sipative quantum brain dynamics (DQBD) 
H provides a representation of a neural 
net characterized by long range correlations 
among the net's units. In this way we ex- 
hibit a link between DQBD and neural net 
dynamics [II]]. 

We present an explicit neural net model 
which allows to memorize a sequence of sev- 
eral informations without reciprocal destruc- 
tive interference, namely we solve the over- 
printing problem, i.e. last registered infor- 
mation does not destroy the ones previously 
registered. The net is also able to recall in- 
formations registered prior to the last regis- 
tered one in the sequence. 

In the following we will first introduce 
the general theoretical background on which 
our neural net is modeled and then we will 
present some of its specific features and the 
results, which, although preliminary, confirm 
our expectations. 



We consider a three-dimensional set of N 
interacting units (neural units) sitting each 
one in a space-time site x n = (x n ,t n ),n = 
1, 2, ..TV. Each unit can be in the state on (1) 
or off (0). The neural unit activity is char- 
acterized by the amplitude of the emitted 
pulse and by the phase determined by the 
emission time. This suggests to us that each 
unit can be described by a complex doublet 
field tp(x n ) = (ipu(xn), ipd(x n )), with ip 
and ipd(%n) complex field components, u and 
d denoting the field inner degrees of freedom 
corresponding to on and off, respectively. 

At each site x n the field inner variable may 
assume a well specified value (u or d). The 
set of these values for all the sites specifies 
the microscopic configuration in the {u — d)- 
space; however, in full generality the specifi- 
cation of the macroscopic or functional state 
of the net does not actually requires that 
correspondingly one should have a unique, 
well definite microscopic configuration where 
each unit state is specified by a definite u or 
d value. In general, indeed, many distinct 
microscopic configurations of the component 
units may correspond to the same functional 
state of the net. 

This means that a given (equilibrium) 
state of the net may be well compatible with 
fluctuations in the states of the individual 
component units. This amounts to say that 
the net state is not strictly and crucially de- 
pendent on the specific state of each indi- 
vidual unit: i.e. we admit enough plasticity 
(as contrasted with rigidity) for the net; in 
other words, we can say that the net macro- 
scopic state is the output, or the asymptotic 
state, emerging from the microscopic dynam- 
ics which rules the interaction among the 
component units. 

For large number ./V of component units, 
such a picture is certainly more "realistic" 
than a "rigid" one and could also be more 
appropriate for a possible modeling of the 



natural brain in terms of neural nets (as it 
is well known the brain functional activity is 
not strictly related with the activity of each 
single neuron; in this paper however we will 
not deal with modeling the natural brain). 

One can view such a situation also from 
the perspective of the pulses or signals trav- 
eling on the connections among the units: a 
traveling signal may contribute to excite or 
de-excite a certain unit thus changing its u 
or d state. Consequently, a specific state of 
the net, corresponding to a given dynamical 
distribution of pulses on the net connections, 
is necessarily a state for which the single unit 
states at each site cannot be uniquely spec- 
ified once for ever, due to pulse action on 
the units. As a matter of fact, one should 
consider the unit states as non-observable, 
since any observation on the unit may non- 
trivially interfere with the dynamics of the 
pulses. Only the output of such a dynamics 
is observable and this is why above we have 
called it the asymptotic state of the net (i.e. 
states for time t n — ► =Loo for each n). 

Summing up, since fluctuations are al- 
lowed for the states of the individual unit at 
each site, and thus for the basic field tp( x n), 
and since, as a consequence, in the (u — d)- 
space the uncertainty in the identification of 
the "trajectory" representing the evolution 
of the state of the unit cannot be eliminated 
without strongly interfering with it, we are 
led to treat ip(x n ) like a quantum field satis- 
fying quantum dynamical equations. 

The above considerations lead us to think 
of the neural net in terms similar to the 
ones usually adopted for condensed mat- 
ter physics: the global behavior of the net, 
namely its functional state and its evolution, 
can be characterized by a (classical) macro- 
scopic observable as it usually happens in 
solid state physics, e.g. in superconductivity, 
in ferromagnetism, etc.. Such an observable, 
generally called the "order parameter" , is de- 
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termined by the dynamics of the elementary 
components or units and by its symmetries 
[12, [l3|, 14, |15|| . It may be considered as a 



code specifying the vacuum or ground state 

Like in ferromagnetism one introduces the 
order parameter "magnetization", in our 
present case we introduce the macroscopic 
observable M. whose values are assumed to 
specify the information content of the net. 
We define M = (l/2)|(iV u - N d )\, with N = 
N u + Nil, where N u and denote the num- 
ber of units on and off, respectively. M. is 
the neural net order parameter which char- 
acterizes its macroscopic state. 

The state A4 = is called the "normal 
state" (void of information content); the "in- 
formation states" or "memory states" are the 
ones with A4 ^ (different informations as- 
sociated to different non-zero Ai values). 

Since the information comes to the net 
from the outside, we assume that the neural 
net may be set into a M. ^ state under the 
action of an external input (coupling of the 
net with the environment) and it remains in 
such a state even after the external input is 
not anymore acting on the net (the informa- 
tion has been recorded). In other words, we 
assume that the interaction among the net 
units cannot force, by itself, the net into a 
M. state (i.e. prior of any external input 
the net remains in its normal state). This in 
turn means that, from one side, the basic dy- 
namics describing the interaction among the 
units (i.e. the evolution equations for the 
basic ip(x n ) field) must be invariant under 
the SU{2) group of transformations acting 
on the doublet field ip(x n ). On the other 
side, it also means that the ground state 
is not invariant under the full SU{2) group 
of transformations, i.e. the external input 
triggers the spontaneous breakdown of the 
SU (2) symmetry. 

Notice that, as observed above, there can 



be many configurations of the set of units 
(microscopic configurations) corresponding 
to a given value of Ai, and therefore to a 
given state of the net: M. specifies indeed 
only the difference \(N U — A^)|, but says 
nothing on which ones and how many are 
the sites u and which ones and how many 
are those d; so that any change, or fluctua- 
tion, between the u and d state of the units 
in different sites is allowed, provided the dif- 
ference M is kept constant. In this sense Ai 
is a macroscopic variable. On the contrary, 
the ip(x n ) fields determine the microscopic 
configurations. 

Moreover, the quantum field dynamics 
generates asymptotic equilibrium states with 
negligible fluctuations of Ai. The macro- 
scopic "memory" state of the neural net in- 
dexed by Ai is then a classical limit state in 
the sense of QFT, namely the state for which 
the fluctuations in the number of certain 
modes is negligible with respect to the num- 
ber of the same kind of modes condensed in 
it: in other words, a coherent state |l6| with 
respect to these modes. These condensed 
modes are long range correlation modes. 

We have in conclusion two levels of de- 
scription: i) The dynamical level and ii) the 
asymptotic level. At the dynamical level the 
interaction among the neural units (repre- 
sented by basic fields ip(x n )) is ruled by a 
certain set of dynamical equations, which are 
assumed to be invariant under the SU(2) 
group; this level is precluded to observations. 
At the asymptotic level, the SU(2) symme- 
try is spontaneously broken and the neural 
net state is characterized by the order pa- 
rameter Ai. 

The set of asymptotic fields includes the 
field describing the non-interacting, "free" 
(at t n — > ±oo for each n) units, say 4>(x n ), 
which also is a complex doublet field with 
(u — d) inner freedom, and other fields which 
are generated by the dynamics. By resort- 
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ing to well known results in QFT 14, 12], 
indeed, whenever the order parameter M is 
different from zero, the dynamics generates 
excitation fields describing long range cor- 
relations among the units, which are there- 
fore collective modes (the Goldstone theo- 
rem). These long range modes are massless 
and thus their condensation in the ground 
state does not change its energy; it only pro- 
duces other (ground) states degenerate in the 
energy, different among themselves for their 
condensation content. The stability of the 
memory states is thus insured. The value of 
the order parameter A4 is a measure of the 
collective mode condensation in the ground 
state. 

Since the net is an open system (coupled 
with the environment) and the information 
storage produces by itself the breakdown of 
the time-reversal symmetry |>), we consider 
the QFT for dissipative systems and the neu- 



ral net state can be then recognized [11] to 
be a finite temperature state of QFT. 

The role of dissipation is crucial in solving 
the overprinting problem, namely the prob- 
lem of the net memory capacity: in a sequen- 
tial information recording each information 
storage would over-impose itself to the pre- 
viously recorded one, thus deleting it. In the 
dissipative dynamics, on the contrary, a large 
memory capacity is possible since each infor- 
mation is recorded in each of the many de- 
generate ground states, without destructive 
interference among them ||. 

In other words, dissipation implies that 
the net overall state may be represented as 
a superposition of infinitely many degener- 
ate ground states, or memory states, each 
of them labeled by a different code number 
and each of them independently accessible 
to information storage. Many information 
" files" may then coexist thus allowing a huge 
memory capacity. Non-unitary equivalence 
among different memory states acts as a pro- 



tection against overlap or interference among 
different informations ||. 

In realistic neural net, the finiteness of the 
"volume" (the number of neural units) and 
possible defect effects may spoil unitary non- 
equivalence thus leading to information in- 
terferences and distortions. 

The retrivial of information is described by 
"reading off" the mirror modes of the same 
code number of the information to be re- 
called. These mirror modes are essentially 
a "replication signal" of the one responsible 
for memory storage. The replication signal 
thus acts as a probe by which one "reads" 
the stored information. The process of in- 
formation recalling drives the net into the 
(macroscopic) memory state of code M cor- 
responding to that specific information to be 
retrived. 

We also observe that the mirror modes 
may acquire an effective nonzero mass due 
to the effects of the system finite size. Such 
an effective mass then introduces a threshold 
in the energy to supply in order to trigger 
the "recall" process. This may lead, from 
one side, to "difficulties" in the information 
retrivial; on the other side, it may act as 
a "protection" against unwanted perturba- 
tions and cooperate to the neural net mem- 
ory state stability. 

The study of thermodynamic properties 
shows that the generator of time evolution 
of the net state is the system entropy. The 
stationarity of free energy implies the Bose 
distribution for the collective modes and the 
Fermi distribution for the neural unit fields. 
In this way the traditional activation func- 
tion for neural net units is recovered. For 
further details see @ and 0]. 

Let us now briefly present some of the fea- 
tures of the specific neural net model we have 
worked out and the related results. We will 
give here only a qualitative description of the 



model. See [11] for formal details. 
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The net dynamics is given by the Pauli- 
Dirac equation for a doublet field ip inter- 
acting with an external magnetic field rep- 
resenting the external input. A spatial dis- 
cretization of this equation on a two dimen- 
sional lattice of 20 x 20 sites is adopted, so 
as to transform the original field equation 
into a system of coupled ordinary differen- 
tial equations. Besides the interaction with 
the external magnetic field, the doublet field 
also interacts with the mean magnetic field 
which is generated over the net as a response 
to the external input. We use the Bragg- 
Williams approximation and the mean mag- 
netic field is taken to be proportional to the 
magnetization induced by the external input 
with a proportionality constant given by the 
Weiss constant 7. The dynamical equation 
thus presents a nonlinear term in tp since the 
magnetization is by itself given in terms of 
a bilinear form in ip. The Weiss constant 
7 is also related to the mean value over the 
whole net of the mean values of the connec- 
tion strength for each site. 

The practical implementation of the net 
was done through the following steps: 

a) after explicit representation of the tp 
field components ip u and ipd m terms of their 
real and imaginary parts, we obtained the 
corresponding four equations from the Pauli- 
Dirac equation. 

b) each of the four component field vari- 
ables was expressed product of the site 
activation function times the connectivity 
potential of the site itself. 

c) we considered the nearest neighbor ap- 
proximation for the site connections. 

d) after a spatio-temporal discretization, 
we associated to each unit (i.e. to each site) 
a sigmoidal activation function characterized 
by a "temperature" parameter. 

e) we assumed an independent evolution 
for each of the four component field vari- 
ables. 



f) we used the modulus squared value of 
the activation function of each unit to de- 
termine the time evolution of the activation 
dynamics of the unit itself. 

g) we used simulated annealing in each 
process of writing and of reading (recalling). 

Through the implementation of the above 
steps we obtained a neural net able to record 
a sequence of informations without over- 
printing (i.e. without destruction of previ- 
ously registered informations in the course 
of a subsequent registration process) and to 
able to recall anyone of the registered infor- 
mations (i.e. not simply the last one) under 
presentation of an external input similar to 
the one to be recalled. 

Such results make us confident that a novel 
conceptual and formal scheme in neural net 
modeling may be introduced which is based 
on the simulation of a quantum dynamical 
evolution. 

We are glad to aknowledge partial support 
from MURST and INFM. 
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